Evaluation of multimedia and multilingual information access systems needs to be performed from a usage oriented perspective. This document outlines use cases from the three use case domains of the PROMISE project and gives some initial pointers to how their respective characteristics can be extrapolated to determine and guide evaluation activities, both with respect to benchmarking and to validation of the usage hypotheses. The use cases will be developed further during the course of the evaluation activities and workshops projected to occur in coming CLEF conferences.PROMIS
The PROMISE network of excellence organized a two-days brainstorming workshop on 30th and 31st May 2...
Measuring is a key to scientific progress. This is particularly true for research concerning complex...
As the name suggests, this deliverable has a twofold purpose –on one hand, it provides an analysis a...
Evaluation of multimedia and multilingual information access systems needs to be performed from a us...
Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation (PR...
Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation (PR...
PROMISE is a network of excellence focused on the experimental evaluation of multilingual and multim...
The first report on alternative evaluation methodology summarizes work done within the PROMISE envir...
Deliverable 2.3 (D2.3) is the main outcome of Task 2.3 (T2.3) of the RESPOND-A project [1]. The main...
This book constitutes the refereed proceedings of the 11th symposium of the Cross-Language Evaluatio...
This book constitutes the proceedings of the Third International Conference of the CLEF Initiative, ...
This book constitutes the refereed proceedings of the 11th symposium of the Cross-Language Evaluatio...
Within evaluation frameworks such as the CLEF evaluation platform, many people are involved in diffe...
This paper describes a general framework for evaluating and comparing the performance of multimodal ...
D2.1 - Benchmark suite to evaluate performance and accuracy of the developments (use cases
The PROMISE network of excellence organized a two-days brainstorming workshop on 30th and 31st May 2...
Measuring is a key to scientific progress. This is particularly true for research concerning complex...
As the name suggests, this deliverable has a twofold purpose –on one hand, it provides an analysis a...
Evaluation of multimedia and multilingual information access systems needs to be performed from a us...
Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation (PR...
Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation (PR...
PROMISE is a network of excellence focused on the experimental evaluation of multilingual and multim...
The first report on alternative evaluation methodology summarizes work done within the PROMISE envir...
Deliverable 2.3 (D2.3) is the main outcome of Task 2.3 (T2.3) of the RESPOND-A project [1]. The main...
This book constitutes the refereed proceedings of the 11th symposium of the Cross-Language Evaluatio...
This book constitutes the proceedings of the Third International Conference of the CLEF Initiative, ...
This book constitutes the refereed proceedings of the 11th symposium of the Cross-Language Evaluatio...
Within evaluation frameworks such as the CLEF evaluation platform, many people are involved in diffe...
This paper describes a general framework for evaluating and comparing the performance of multimodal ...
D2.1 - Benchmark suite to evaluate performance and accuracy of the developments (use cases
The PROMISE network of excellence organized a two-days brainstorming workshop on 30th and 31st May 2...
Measuring is a key to scientific progress. This is particularly true for research concerning complex...
As the name suggests, this deliverable has a twofold purpose –on one hand, it provides an analysis a...